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(54) Video image manipulation; controling anti-afias filter for segmented output image 



(57) Input video image data is manipulated, and the manipulated image is segmented into sub-areas with a 
border between the sub-areas. In order to avoid aliassing due to compression of the image an anti-alias filter is 
provided controlled by the degree of compression or local scaling factor in a "tile" (a plurality of neighbouring 
pixels). The local scaling factor is determined, for tiles lying wholly within one sub-area, by comparing the 
separation of pixels having a predetermined spatial relationship with the tile before and after manipulation. 
This breaks down in the case of tiles lying across the border between sub-areas, and for those tiles (shaded in 
figure 5) the scaling factor of individual pixels in a tile are taken as those of the nearest adjacent tile 1, 2, 3, 4 in 
the same sub-area. 




At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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Fig.6B. 




Fig.6C. 
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ANTI-ALIAS FILTER CONTROL FOR A SPLIT PICTURE 

The present invention relates to a method and 
apparatus for anti-alias filter control for a split picture 
5 and more particularly to anti-alias control of an input 
video image which is to be mapped so as to form an image 
which comprises the input video image split into a number of 
segments . 

Often video images are manipulated for particular 
10 effects, an example of which is illustrated in Figure 1 of 
the accompanying drawings. However, when an image is 
manipulated in this way, compression of the image results in 
aliasing distortion of the image. 

It is now contemplated that, during image 
15 manipulation, it may be. required to split an input image 

into a number of segments as illustrated in Figure 2 of the 
accompanying drawings. 

It is an object of the present invention to provide a 
method and apparatus for reducing the effects of aliasing 
20 distortion when manipulating an image, in particular, when 
an image is to be split into segments. 

According to the present invention there is provided a 
method of filtering input video image data representing an 
input video image, where the input video image data is to be 
25 manipulated to form output video image data representing an 
output video image, where the manipulation includes 
segmentation of the input video image into sub-areas and 



where the output video image comprises at least one of the 
sub-areas, the input image treated as being made of a 
plurality of tiles, each tile comprising a plurality of 
pixels, the method comprising the steps of: 
5 for each of said tiles which is of a first type, 

calculating local scaling factors representative of the 
degree to which the tile is compressed by said manipulation 
by comparing the separation, before manipulation, of pixels 
having a predetermined spacial relationship with the tile, 
10 with the separation after the manipulation, a tile being of 
said first type when all the pixels having the predetermined 
spacial relationship with said tile lie in the same sub- 
area; 

for each tile where pixels having the predetermined 
15 relationship with said each tile lie in more than one sub- 
area, selecting, for each individual pixel of said each 
tile, local scaling factors of the adjacent tile of said 
first type nearest to said each individual pixel and in the 
same sub-area as said each individual pixel; and 
20 spacially filtering the pixels of said plurality of 

tiles in a manner which takes account of said local scaling 
factors • 

According to the present invention there is also 
provided an apparatus for filtering input video image data 
25 representing an input video image, where the input video 
image data is to be manipulated to form output video image 
data representing an output video image, where the 
manipulation includes segmentation of the input video image 
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into sub-areas and where the output video image comprises at 
least one of the sub-areas, the input image treated as being 
made up of a plurality of tiles, each tile comprising a 
plurality of pixels, the apparatus comprising: 
5 calculating means for calculating, for each of said 

tiles which is of a first type, local scaling factors 
representative of the degree to which the tile is compressed 
by said manipulation by comparing the separation, before 
manipulation, of pixels having a predetermined spacial 

10 relationship with the tile with the separation after the 
manipulation, a tile being of said first type when all the 
pixels having the predetermined spacial relationship with 
said tile lie in the same sub-area; 

selecting means for selecting, for each individual 

15 pixel of each tile where pixels having the predetermined 
relationship with said each tile lie in more than one sub- 
area, local scaling factors of the adjacent tile of said 
first type nearest to said each individual pixel and in the 
same sub-area as said each individual pixel; and 

20 filtering means for spacially filtering the pixels of 

said plurality of tiles in a manner which ta.kes account of 
said local scaling factors. 

The anti-alias filtering may be produced by local 
scaling factors which are calculated for horizontal and 

2 5 vertical directions based on the horizontal and vertical 
compressions introduced by the image manipulation. Thus, 
the image may be divided in the horizontal and vertical 



directions so as to form a plurality of tiles, the local 
scaling factors being determined in both the horizontal and • 
vertical directions and the anti-alias filters being 
controlled to operate at a "tile level" for the entire 
5 image. 

Whereas splitting the input image would otherwise 
result. in irregularities in the image as a result of the 
process of anti-alias filtering, the present invention 
provides a method by which, despite such splitting, the 
10 input image may be appropriately filtered. 

The invention will be more clearly understood from the 
following description, given by way of example only with 
reference to the accompanying drawings in which: 

Figure 1 illustrates an example of known image 
15 manipulation; 

Figure 2 illustrates a variation of the manipulation 
of Figure 1 in which the image is split into four segments; 

Figures 3 and 4 illustrate split boundaries occurring 
within image tiles; 
20 Figure 5 illustrates how different areas of a split 

tile are processed; 

Figures 6A to 6C illustrate tiles at a pixel level and 
their compression and splitting; 

Figures 7A and 7B illustrate, at a pixel level, how 
25 scaling factors are chosen for tiles effected by a split; 
and 

Figure 8 illustrates the relationship of pixels for 
the purposes of calculating local sealing factors. 

It is known to use an apparatus for video image 
30 processing such that an input image which would normally 



fill an entire screen may be altered in size and/or 
processed so as to appear to lie on a three dimensional 
surface within the screen. 

An example of this form of processing is shown in 
5 Figure 1 where an image is projected onto a perspective 

surface extending into the screen. In practice, this may be 
implemented as a write side system or as a read side system 
i.e. achieving the image manipulation by writing pixel data 
to an address different to its original address or reading, 

10 for a particular address, pixel data from a different 
address in the original information. 

This processing of the image data results in a 
compression of the image and aliasing distortion of the 
resulting image. To overcome this problem, an image 

15 processing apparatus es proposed which uses anti-alias 
filters to appropriately filter the image data prior to 
manipulation so that, upon manipulation, the aliasing 
distortion is reduced. 

The image is first, at least notionally, divided into 

20 "tiles" 10 as shown in the accompanying figures. The width 
and height of each tile is examined before and after the 
manipulation so that horizontal and vertical scaling factors 
may be determined individually for each tile and appropriate 
band widths set for the horizontal and vertical prefilters. 

25 Figure 6 illustrates a specific example with 4x4 

sixteen pixel tiles 10 in which the horizontal and vertical 
scaling factors for tile 10 arts calculated by comparing the 



spacings of pixels A and A H and pixels A and Ay respectively 
before and after manipulation. Considering the horizontal 
scaling factor in more detail, the spacing between pixels A 
and A H before manipulation is clearly the standard four pixel 
spacing. However, if after manipulation tile 10 has been 
compressed to half its width, as illustrated in Figure 6B, 
the spacing between pixels A and is reduced to only two 
pixels. Such compression may be produced in only the 
horizontal or only the vertical direction, but as 
illustrated in Figure 6B, the spacing between pixels A and Ay 
is also reduced to only two pixels. 

Considering calculation of the local scaling factors 
in more detail, based on the parameters shown in Figure 8, 
expressions for the local scaling factors may be derived as 
follows: 

Ih = phsin9 ph = /(xh) 2 + (yh) 2 

lv = pvsin9 pv = /(xv) 2 + (yv) 2 

6 = 18O°-(0-a) 

sin (18CT-(0-a) ) = sin (p-a) 

tana = -yh tan£ = w 

xh -xv 

lh = /(xh) 2 + (yh) 2 . sin (£-a) = f (xh,xv, yh,yv) = LSX 
lv = /(xv) 2 + (yv) 2 . sin (0-a) = g(xh,xv,yh,yv) = lsy 

The values for xh and xv are found by calculating the 
difference in horizontal tile addresses for horizontally and 
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vertically adjacent tile corners respectively. The values 
for yh and yv are calculated similarly from the vertical 
tile addresses. 

The values for xh and yh are processed by a 
5 rectangular to polar coordinate converter to generate their 
magnitude and angle a. The magnitude of xv and yv and angle 
p are generated in the same way. 

The value for sin(/?-cr) is obtained from a look-up 
table, stored in PROM. 
10 After LSX and LSY are computed, the final filter 

control data is derived as follows: 

For LSF 1, the value is limited to OxlF (this will 
select a bypass set of coefficients on the Prefilters, as no 
anti-alias filtering is required under these circumstances) . 
15 For LSF < 1, the value is quantized to 5 bits in the 

range 0x00 (minimum filter bandwidth) to OxlE (maximum 
filter bandwidth) . These data values will select 1 of 31 
possible low pass filter coefficient sets of the Prefilters. 

Therefore, the H and V filters are controlled 
20 independently and are applied to all . pixels in the tile for 
which the LSFs are calculated. 

Referring to Figure 2, it is also possible to split an 
input image into a number of segments 20 when manipulating 
the image to lie on the three dimensional surface. 
25 In the most flexible system, an image can be split at 

any pixel. However, according to the system described 
above, if the image is split along a vertical line passing 



between pixels C and D, as illustrated in Figure 6C, when 
the scaling factors are calculated for tile 10, the spacing 
between A and will have increased to a seven pixel width 
even though- no expansion of the pixel data within tile 10 
has occurred. Thus, the process described above for 
calculating appropriate scaling factors is no longer 
suitable, since comparison of pixel addresses either side of 
the split will not give a true indication of compression. 

Indeed, the above process is not even suitable for the 
present system of tiles even when the split occurs along a 
tile boundary, since the split will still separate pixel 
addresses used in the calculation of local scaling factors. 

A system is now proposed in which, when the local 
scaling factors of a particular tile would otherwise be 
calculated incorrectly i.e. pixels used for the calculation 
of scaling factors for a tile lie in more than one output 
image segment, the local scaling factors of the pixels of 
that tile are taken to be those of the adjacent unaffected 
tile. 

It is necessary to decide which local scaling factors 
are to be used at the split boundary (see Figure 3). This 
decision is further complicated when the data being 
manipulated is demultiplexed, in particular due to higher 
processing rates used for high definition video images used 
in HDTV. 

The strategy proposed relies upon knowing data prior 
to and in advance of a particular tile being processed and 



on determining the scaling factors for a pixel of a split 
tile to be those of the nearest complete or unsplit tile on 
the same side of the split boundary e.g. in the same output 
segment. 

Since the split boundary can occur at any pixel, i.e. 
any phase of the image data, the incoming local scaling 
factors should be able to be resolved to pixel/phase 
accuracy to determine which of the nearest complete tiles is 
to be selected for filtering data near the split boundary. 

Figure 4 illustrates the proposed strategy in which 
the shaded tile denotes the area around the split boundary 
where it becomes necessary to derive local scaling factors 
from the nearest complete tiles. The following equations 
explain the proposed scheme: 

If X lu < X s select tile values before current tile 

If X IM > X s select tile values after current tile 

If Y IN < Y s select tile values before current tile 

If Y IN > Y s select tile values after current tile 

Where X JM , Y IN denote the horizontal and vertical 
addresses for the manipulated image. 

Where X s , Y B denote the horizontal and vertical split 
axis. 

Figure 5 shows in more detail , the tile area to be 
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selected for the local scaling factors when the tile region 
is around the split boundary. The four arrows (labelled 1 
to 4) show which tile the local scaling factors will be 
taken from for the appropriate segments of the shaded tile 
5 around the split boundary. 

At a pixel level, Figures 7 and 8 illustrate also with 
arrows which adjacent tiles are chosen to determine the 
scaling factors for the pixels of an effected tile. 

Since the split can occur at any pixel/line and an 
10 apparatus can apply this method to demultiplexed video data, 
as well as non demultiplexed data, it may be required to 
supply different local scaling factors for each of the 
demultiplexed phases of data. 
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CIAIMS 

1. A method of filtering input video image data 
representing an input video image , where the input video 
image data is to be manipulated to form output video image 
5 data representing an output video image, where the 

manipulation includes segmentation of the input video image 
into sub-areas and where the output video image comprises 
at least one of the sub-areas , the input image treated as 
being made of a plurality of tiles, each tile comprising a 

10 plurality of pixels, the method comprising the steps of: 

for each of said tiles which is of a first type, 
calculating local scaling factors representative of the 
degree to which the tile is compressed by said manipulation 
by comparing the separation, before manipulation, of pixels 

15 having a predetermined spacial relationship with the tile, 
with the separation after the manipulation, a tile being of 
said first type when all the pixels having the predetermined 
spacial relationship with said tile lie in the same sub- 
area ; 

20 for each tile where pixels having the 

predetermined relationship with said each tile lie in more 
than one sub-area, selecting, for each individual pixel of 
said each tile, local scaling factors of the adjacent tile 
of said first type nearest to said each individual pixel and 

25 in the same sub-area as said each individual pixel; and 

spacially filtering the pixels of said plurality 
of tiles in a manner which takes account of said local 
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scaling factors. 

2. A method according to claim 1 wherein said input 
video image is treated as being divided in horizontal and 
vertical directions so as to form rectangular and/or square 

5 tiles. 

3. A method according to claim 2 wherein at least 
one of the pixels having the predetermined spacial 
relationship with a tile is at a corner of the tile. 

4. A method according to claim 2 or 3 wherein at 
10 least one of the pixels having the predetermined spacial 

relationship with a tile is at the corner of an adjacent 
tile. 

5. A method according to claim 2, 3 or 4 wherein 
said step of calculating includes comparing the addresses, 

15 before manipulation, of pixels having the predetermined 

spacial relationship with a tile with the separation after 
said manipulation so as to determine the horizontal and 
vertical compression of the tile resulting from the 
manipulation. 

20 6. A method according to any one of claims 2 to 5 

wherein each pixel located in said each tile is filtered in 
a manner which takes account of the vertical local scaling 
factor of the adjacent tile of said first type nearest to 
said each pixel and in the same sub-area. 

25 7. A method according to any one of claims 2 to 6 

wherein each pixel located in said each tile is filtered in 
a manner which takes account of the horizontal local scaling 



factor of the adjacent tile of said first type nearest to 
said each pixel and in the same sub-area. 

8. method according to any preceding claim 
wherein each of said tiles comprises sixteen pixels arranged 
in four columns and four rows, 

9. An apparatus for filtering input video image 
data representing an input video image , where the input 
video image data is to be manipulated to form output video 
image data representing an output video image, where the 
manipulation includes segmentation of the input video image 
into sub-areas and where the output video image comprises at 
least one of the sub-areas, the input image treated as being 
made up of a plurality of tiles, each tile comprising a 
plurality of pixels, the apparatus comprising: 

calculating means for calculating, for each of 
said tiles which is of a first type, local scaling factors 
representative of the degree to which the tile is compressed 
by said manipulation by comparing the separation, before 
manipulation, of pixels having a predetermined spacial 
relationship with the tile with the separation after the 
manipulation, a tile being of said first type when all the 
pixels having the predetermined spacial relationship with 
said tile lie in the same sub-area; 

selecting means for selecting, for each 
individual pixel of each tile where pixels having the 
predetermined relationship with said each tile lie in more 
than one sub-area, local scaling factors of the adjacent 



tile of said first type nearest to said each individual 
pixel and in the same sub-area as said each 
individual pixel; and 

filtering means for spacially filtering the 
5 pixels of said plurality of tiles in a manner which takes 
account of said local scaling factors. 

10. An apparatus according to claim 9 wherein said 
input video image is treated as being divided in horizontal 
and vertical directions so as to form rectangular and/or 
square tiles. 

11. An apparatus according to claim 10 wherein at 
least one of the pixels having the predetermined spacial 
relationship with a tile is at a corner of the tile. 

12. An apparatus according to claim 10 or 11 wherein 
at least one of the pixels having the predetermined spacial 
relationship with a tile is at the corner of an adjacent 
tile. 

13. An apparatus according to claim 10, 11 or 12 
wherein said calculating means, in use, compares the 
addresses, before manipulation, of pixels having the 
predetermined spacial relationship with a tile with the 
separation after said manipulation so as to determine the 
horizontal and vertical compression of the tile resulting 
from the manipulation. 

14. An apparatus according to any one of claims 10 
to 13 wherein each pixel located in said each tile is, in 
use, filtered in a manner which takes account of the 
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vertical local scaling factor of the adjacent tile of said 
first type nearest to said each pixel and in the sane sub- 
area . 

15. An apparatus according to any one of claims 10 
5 to 14 wherein each pixel located in said each tile is, in 
use, filtered in a manner which takes account of the 
horizontal local scaling factor of the adjacent tile of said 
first type nearest to said each pixel and in the same sub- 
area. 

10 16. An apparatus according to any preceding claim 

wherein each of said tiles comprises sixteen pixels arranged 
in four columns and four rows. 

17. A method of filtering an input video image data 
substantially as hereinbefore described with reference to 

15 and as illustrated by the accompanying drawings. 

18. An apparatus for filtering an input video image 
data constructed and arranged substantially as hereinbefore 
described with reference to and as illustrated by the 
accompanying drawings. 
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